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(54) Color reproduction terminal apparatus, network color reproduction system, and color 
reproduction method 



(57) A color reproduction system accurately cor- 
rects color displayed on a user's own display by gener- 
ating a profile at a server. In order to allow each user to 
obtain a service for performing accurate color reproduc- 
tion through a network. This system includes a network 
connecting section (107) for connecting a color repro- 
duction terminal apparatus to a network: a cokar image 
display (105) for displaying a color Image; a color cam- 
era. (101) or a sensor (102) lor capturing a color repro- 

Rg- 1 



ductlon characteristic of the cotor Image display and a 
viewing lliumlnant condition; and a color converting sec- 
tton that provides color conversion for the color image 
obtained through the network and outputs It to the color 
Image display. The color conversion may be provided for 
a color Image obtained though the network using a color 
conversion profile and a color conversion program 
whk:h are downloaded through the network. ■ 
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Description 

BACKGROUND OF THE INVENTION 
5 FIELD OF THE INVENTION 

[0001] The present invention relates to color managennent and correction technology employing a color display ter- 
minal and a network color reproduction system using the terminal. 

70 DECRIPTION OF THE RELATED ART 

[0002] Recently, in the field of a color management technology, a software system tor color management has been 
installed in an operating system (OS) level for providing color matching between color devices such as scanners, dis- 
plays, and printers. In this color management system (hereinafter referred to as CMS), device color conversion charac- 

15 teristic information called a color conversion profile is prepared in advance for each color device, and is installed as a 
colorconvertlngpartin an OS of a personal computer (PC). The color converting part converts a color value to a device 
value by performing the color conversion of a color image based on the color conversion profile. Measurement of such 
display characteristic and modeling of the device are hereinafter called "characterizations". The color conversion profile 
of a color device is produced based on a measurement result of the color device and a calculation algorithm by a color 

20 device manufacturer. The color conversion profile is provided to a user together with the color device when the user pur- 
chases the color device. 

[0003] At the present time, the color management can be practically and effectively operated only in a very narrow 
field for of the following reasons. 

[0004] Firstly, a color device and an apparatus using it generally have their individual difference and aging variation. 
25 When the cotor device is intended to be characterized, accuracy of color reproduction is still low even using a typical 
color conversion profile provided by the manufacturer. In addition, color reproduction characteristic of a color display Is 
greatly affected by characteristics of not only the display itself but also a display card built in a PC. The user is therefore 
required to perform the characterization of his/her color device by himself/herself. 

[0005] Rg. 20 shows a characterization method or a calibration method of a display in accordance with the prior 
30 art. Colorimeter 2001 is adsorbed to display 2005, reads a color signal, and feeds color signal data into PC 2004 via 
measuring equipment Interface 2002 and cable 2003, The PC generates a display profile or finely adjusts the profile In 
relation to secular changes by software. For this adjustment, however, an originally unnecessary measuring equipment 
is required, and the display must be measured before every usage thereof. This is troublesome for common users, and 
is not practical. 

35 [0006] Secondly, not all PCs support color management. Recently-developed PCs may perform the color manage- 
ment at an OS level, but many PCs, among an unspecified number of those linked to a network, have an OS that does 
not support the color management itself These PCs cannot perform the color management itself. 
[0007] Thirdly, there is a problem of cross media color reproduction, which has recently become especially contro- 
versial. In other words, color reproduction under different illumlnant conditions or between different types of media such 

40 as a display and a printer cannot be achieved in a conventional colorimetric color reproduction method. Color appear- 
ance on a display varies under different illuminations, because different illuminations have different effects on the color 
appearance. A color conversion method in this case has not been developed. 

SUMMARY OF THE INVENTION 

45 

[0008] A color reproduction terminal apparatus in accordance with the present invention Includes a cotor cannera 
with a known characteristic, always or adequately captures images on a display surface using the camera from a 
remote position, and measures a color reproduction characteristic of the display. In addition, the terminal apparatus 
automatically generates a display profile optimized for a user's own color display. In an applicatran such as an interac- 

50 tive television (TV) meeting or a remote medical system, the display and the color camera are normally placed on the 
user side, and therefore, installation of an additional color camera as a new apparatus is not required. 
[0009] A display measurement method defined by International Electrotechnkxil Commission (lEC) / TC1 00 or the 
like describes the measurement from a spaced position at a certain distance from a display, especially in relation to a 
liquid crystal display (LCD). The color reproduction terminal apparatus in the present invention can also be used fir such 

55 measurement. A profile-generating part is placed not in a user terminal but in a color reproduction server on a network 
in order to improve flexibility of an algorithm. The user terminal downloads, from the color reproductton server, charac- 
terisfic data of the color camera and color patch data used for the nrieasurement of the display. Then, the user terminal 
measures the display characteristic and transmits a measurement result to the color reproduction server. The color 
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reproduction server generates the user's display profile based on this measurement result, and therefore, the user ter- 
minal can aulomatlcally download a color conversion profile optimized for his/her own display. 

[0010] In a network color reproduction system provided in the present invention, the color reproduction server 
stores a color conversion program executable at the user terminal. The user terminal automatically downloads this pro- 
5 gram and performs the color management. This Is performed by a World Wide Web (WWW) browser and JAVA applet 
in the present Internet. 

[0011] A color reproduction terminal provided in the present invention includes a simple illuminant light sensor. This 
sensor captures ambient illumination during image-capturing by the color camera at the terminal and during viewing the 
display Based on the obtained illuminant light information, a colorimetric value Indicated at the user terminal is cor- 
10 rected. In this way, the reproduced color on the display Is accurately corrected under various environments such as in 
a darkroom, in a general room, or out of doors. 

[0012] In the color reproduction method In the color reproduction system in accordance with the present invention, 
conventional XYZ values (tristimulus values) are matched, and additionally, matching in the color appearances and 
matching in spectral distributions are effected. ^ 

IS 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0013] 

20 Fig. 1 is a block diagram of a color reproduction terminal apparatus in accordance with a first exennptary embodi- 

ment of the present invention. . " . 

Fig. 2 is an external view of the color reproduction terminal apparatus in accordance with the first exemplary 
embodiment. 

. Fig. 3 shows three types of setting methods of a camera head in the color reproduction ternninal apparatus. 
2S Fig. 4 Is an external view of a color reproduction terminal apparotus using a projector. 

Fig. 5 shows an operation of a cojor reproduction terminal apparatus that supports color management. 
Fig. 6 shows an operation of a color reproduction terminal apparatus that does not support color management. 
Fig. 7 is a block diagram of a network color reproduction system in accordance with the first exemplary embodi- 
ment. 

30 Fig. 8 is a flowchart for generating a display profile in accordance with the first exemplary embodiment. 

Fig. 9 is a block diagram of a color reproduction terminal apparatus in accordance with a second exemplary embod- 
iment. 

Fig. 1 0 is an external view drawing of the color reproduction terminal apparatus In accordance with the second 
exemplary embodiment. 

35 Fig. 11 is a block diagram of a network color reproduction system used for network shopping in accordance with 

the third exemplary embodiment. 

Fig. 12 is a flowchart for an operation of the network color reproduction system used for network shopping. 
Fig. 1 3 is a flowchart for a correcting process of illumination, chromatic adaptation, and contrast. . 
Fig. 14 Is a flowchart for a correcting process of illumination, chromatic adaptation, and contrast of a color repror 
40 ductlon terminal apparatus in accordance with a fourth exemplary embodiment 

Fig. 1 5 is a block diagram of a network color reproduction system used for network shopping in accordance with a 
fifth exemplary embodiment. 

Fig. 16 Is a flowchart for an operation of the network color reproductfon system used for network shopping in 
accordance with the fifth exemplary embodiment. 
45 Fig. 1 7 shows a multi-dimensional primary color conversion process in the network color reproduction system. 

Fig. 1 8 is a block diagram of a network color reproduction system used for a remote medical care servk:» in accord- 
ance with a sixth exemplary embodiment. 

Fig. 19 is a flowchart for an operation of the network color reproductbn system used for the remote medical care 
service. 

50 Fig. 20 shows a conventional color reproduction terminal apparatus. 
DESCRIPTION OF THE PRERERRED EMBODIMENT 
(Preferred ennbodiment 1) 

55 

[0014] Fig. 1 illustrates a structure of a color reproduction terminal apparatus in accordance with embodiment 1. 
[0015] The color reproduction terminal apparatus in Fig. 1 has a function for accurately displaying a color image 
downloaded through a network on a color display. This terminal apparatus Is constituted with CPU 106. network inter- 
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face 107, memory 108, hard disk 109, color display/projector 105, color camera 101, illuminant light sensor 102, input 
unit 1 10, and output unit ill. 

[001 6] Color camera 1 01 is used tor capturing interactive picture images or screen images in a remote medical care 
service or a TV meeting, and for measuring a screen of display 105 for color management. Illuminant light sensor 102 
5 obtains image-capturing environment infomnalion of color camera 101 for the color management and Illuminant infor- 
mation under a viewing environment where display/projector 105 is placed. Some of such computer systems have en 
OS having built-in CMS, and others have an OS having no built-in CMS. The present invention considers both cases, 
and does not impose a specific restriction. 

[001 7] This terminal apparatus, for measuring a screen of a user display, employs not a special sensor but an inex- 
?t7 pensive and simple color camera which is usually used for a TV meeting. Color indicated on the display can be meas- 
ured from a position near an observer's point of view, by designing a support and a cannera bead of the color camera 
to make a direction and a position of the color camera changeable. 

[0018] Fig. 2 is a penspectrve view of the color reproduction terminal apparatus In accordance with this embodi- 
ment. Color camera 203 is supported by a camera arm 204. Camera amn 204 ia movably connected with a display table 

15 205, and a camera head can be also freely rotated. In this mechanism, color camera 203 is fixed to a position arbitrary 
in relation to display screen 202. Fig. 2 illustrates just a concept, and various actual mechanisms, in addition to this 
example, are within the scope of the present invention. A signal from color camera 203 is fed into a computer system 
201 through display table 205, though this is not shown In Fig. 2. This signal is an analog or digital video signal. Illumi- 
nant light sensor 206 is used for obtaining viewing illuminant infomnatton of display screen 202 and color camera 203. 

20 Color camera 203 with a filter attached to its lens and an additional signal processor can be used in place of illuminant 
light sensor 206. 

[001 9] Rg. 3 shows setting examples of color camera 203 in three types of operations of the color reproductfon ter- 
minal apparatus in accordance with this embodiment. 

[0020] In example 301 in Fig. 3, a color reproduction characteristic of display 202 Is measured for characterization 
25 or calibratiDn of display 202. Color camera 203, which is directed to a screen of display 202, captures displayed color 
or color patch 302, and the captures signal is taken into computer 201. At this time, usually, illumination in a room is 
preferably set under a darkroom state. Color cannera 203 is preferably set facing the screen of display 202. and is 
spaced by a distance usually selected by a user, and camera ami 204 has a freedom applicable to it. 
[0021] Example310 shows a setting of the color reproduction terminal apparatus of this embodiment in an applica- 
30 tion in which a color image is displayed and observed on display 202 through a network, such as in netvrork shopping 
or an electronic museum. In this case, color camera 203 is not required, and is folded so that it does not disturb the 
viewing over the front of Ihe display. Color camera 203 nnay always capture the display screen to perform color man- 
agement of display 202. 

[0022] In example 320, an application to a remote medical care service or a TV meeting is assumed. Because state 
35 or dynamic images formed by capturing an inriage of the face of user 322 with color camera 203 are transmitted 
between a plurality of users, the head of cotor camera 203 is rotated and set at a position for capturing the image of the 

face of user 322. 

[0023] In Fig. 3. a cathode ray tube (CRT) or LCD is used as the display. On the other hand, Rg, 4 shows a state 
where a projector Is used. This apparatus comprises projector 401 used instead of the CRT or LCD display, and a 
40 screen 402. Reference numeral 404 denotes a camera head directed to the screen and to enable colorimetry'of pro- 
jected color image 403. Reference numeral 405 denotes a camera head photographing user 322. Hereinafter, the dis- 
play includes the projector. 

[0024] Fig. 5 is a schematic diagram of a process of CMS in a color reproduction terminal apparatus of embodiment 
1 In many present computers, CMS is embedded in the OS. Variation of reproduced colors caused by difference of 

45 applications can be eliminated by the CMS of embodiment 1 . 

[0025] The CMS is constituted with color conversion part 506, i.e. a sofhware module for performing a color conver- 
sion process of a color image, and color conversion profile 504, i.e.. a color reproduction characteristic file of a color 
devrce such as a display included In color conversion part 506. Color conversion profile 504 is supplied by a manufac- 
turer that produces a color device such as a color camera or a color display. In the CMS. a color oonversion profile of a 

so source-side color device converts a device -de pendent color space of the color image to a device-independent color 
space, and then a color conversion profile of a destination-side color device converts the device-independent color 
space to a devk:e-dependent color space, 

[0026] For example, when a color image through the Internet is observed by a user's display, the color image 
through the Internet is nwstly represented in a standard red-green-blue (sRGB) color space. Color image 502 sent 
55 through Internet 501 is converted to an XYZ color space with sRGB profile 503, and is converted from the XYZ color 
space to an RGB color space with user's color conversion profile 504 in color conversion part 506 on a user PC. Then, 
the image is displayed on display 508 at a correct RGB value. 

[0027] Such a method that XYZ color space is matched to perform color reproduction is executed in a relatively sim- 
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pie system, and is frequently used. But it is hardly said tliat this method is really accurate. This is based on the following 
facts. 

* 

(1) Color displacement is caused even when displaying a color o1 the same XYZ value is intended, because max)- 
6 mum luminance or color range capable of being tapped-otf varies for each display and color range mapping is per- 
formed. 

(2) Color reproduction by the method where the XYZ value is matched is allowed only when the same type oi media 
are observed under the same illumination, but is not allowed when Illumination varies or an actual object is visually 
compared with an image on the display. In particular, a color appearance model has been studied and standardized 

TO as "color reproduction between cross media," and an algorithm relating thereto has been developed. 

[0028] For performing higher accuracy color reproduction while considering the facts mentioned above, the color 
reproduction terminal apparatus of this embodiment includes a sensor for measuring Illumination In an environment 
where the user display is placed. In this apparatus, the color conversion profile generated from values measured by this 
rs sensor and the color conversion part for carrying out the actual color reproduction using this color conversion profile are 
constituted as a stationary module. In addition, in anticipation that research study results of color appearance models 
will be hereinafter sequentially standardized, the apparatus has a constitution where a color conversion software mod- 
ule is downloaded from an Individual color reproduction server placed on the network. 

[0029] Fig. 5 and Fig. 6 show a software structure in the color reproduction tenninal apparatus in accordance with 
20 the present invention. Fig. 5 shows the apparatus in which the CMS is embedded in the OS of the color reproduction 
terminal, and Fig. 6 shows the apparatus in which the CMS is not embedded. In Fig. 6, it is assumed that the color con- 
version software module is downloaded from nehwork 601 to color conversion part 604. The CMS function ts realized 
not at the OS level but at application level 606 such as a network browser 

[0030] Fig. 7 shows a structure of a network color reproduction system in accordance with this embodiment. Color 
2B reproduction terminal apparatus 705 as a user terminal and color reproduction server 706 are placed'on network 707. 
In sen/er 706, the following elements are stored: 

(a) color patch data 701 ; 

(b) camera profile database 702 for storing a color conversion profile of a camera In the user terminal; 
30 • (c) profile generating program 703 for generating a display profile of the user terminal; and 

(d) color conversion part program 704 that Is downloaded to the user terminal and is used to perform color conver- 
sion. 

These elements are required for performing characterization of the display of terminal apparatus 705. 

35 [0031] Color patch data 701 comprises tens of color patched data represented by RGB data, and is used to meas- 
ure the color.reproduction characteristic of the display. Camera profile database 702 is produced for each product basi- 
cally by a camera manufacturer. A user can download an image-capturing characteristic of a camera through network 
707, based on Information such as a model of the camera actually used in cotor reproduction termirial apparatus 706 
on the user terminal side. Profile generating program 703 is a program for gene rating, the display, profile discussed 

40 below. Color conversion part program 704 is a module for perfomiing color conversion not on color reproduction server 
706, but on terminal apparatus 705 after being sent into terminal apparatus 705 on the user tenninal side. 
[0032] A procedure is described for carrying out the color reproduction using this netvrork color reproduction sys- 
tem. The user must initially calibrate a devfce of his/her own color reproduction temitnal apparatus 705. In this embod- 
iment, this calibration is performed as follows: 

45 ' 

(1) capturing display screen 202 with color camera 203 attached to user tenninal 705; 

(2) sending captured data to color reproduction server 706, and causing the server to generate the display profile; 
and 

(3) downloading this profile to user terminal 705. 

50 

Fig. 8 shows this procedure. 

[0033] At step 801 , cokDr patch data 701 having a plurafity of colors is transmitted from color reproduction server 
706 In the RGB data form in response to a request of color reproduction terminal apparatus 705. At step 802 terminal 
apparatus 705 obtains color patch data 701 through network 707, and at step 803 terminal apparatus 705 displays color 
55 patch data 701 on display 202. 

[0034] In terminal apparatus 705, at step 804, the user sets camera 203 at a position Indicated in example 301 In 
Fig. 3, and captures a color patch image on display 202 using camera 203. The captured color patch image is obtained 
as RGB data, after a process for reducing data amount such as a calculation of an average value of a plurality of rep- 
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resentatlve picture elements of each color patch from the image. This RGB data value is derived by reading the color 
patch data with the camera, is different from the original RGB data value of the color patch (obtained at step 602), and 
is affected by a color development characteristic of display 202 and an Image-capturing characteristic of camera 203. 

[0035] At step 805 and step 806, the RGB data of the image captured color patch is sent out to color reproduction 
5 server 706. At step 807, camera information such as the model number of camera 203 used tor capturing the Image of 
color patch data 701 is sent out from terminal apparatus 706 to color reproduction server 706, 

[0036] At step 608, server 706 searches camera profile database 702 based on the obtained camera information 
to select a camera profile. At step 309 and step B10, terminal apparatus 705 obtains the selected profile. The camera 
information, more specifically, means the product number of the camera being used and the like.. An aging variation or 
10 individual difference for the same model In relation to characteristics of a CCD or a color filter of the camera is consid- 
ered to be relatively small. 

[0037] At step 81 1 , server 706 converts the RGB data of color patch data 701 to XYZ data with the camera profile. 
At step 812, server 706 derives a display profile of terminal apparatus 705 from the XYZ data. Because color Indicated 
by this XYZ data is color-reproduced when display 202 develops color of color patch data 701, a color reproduction 
15 characteristic of display 202 can be calculated if an image-capturing characteristic of camera 203 is available. 

[0038] At step 813. the display profile calculated by server 706 is sent to terminal apparatus 705, and terminal 
apparatus 705 obtains its own display profile. 

[0039] As discussed above, in this embodiment, because a display profile generating algorithm is placed on a color 
reproduction server outside the user terminal, it can be arbitrarily upgraded and Is variously advantageous for the user. 
20 These procedures are written in a program executable by a computer, are stored In a hard disic or a portable storage 
medium, and axe executed in terminal apparatus 705 and server 706. 

(Preferred embodiment 2) 

25 [0040] Fig. 9 illustrates a structure of a color reproduction terminal apparatus in accordance with embodiment 2. 
The Fig. 9 apparatus differs from a structure in Fig. 1 In embodiment 1 in that the structure in Fig. 9 has person Image- 
capturing camera 901 and display capturing camera 902. As shown in Fig. 10, person image-capturing camera 1001 
captures the image of the user's face on the color reproduction terminal apparatus, and display capturing camera 1002 
always or intermittently captures color patch region 1003 on display 202. 

30 [0041] In this structure, one additional camera is required. However, in an interactive application between users 
such as a remote medical care service discussed below, the CMS In the color reproduction terminal apparatus always 
operates, and can correspond to time-dependent variation of light In a viewing environment. 

[0042] The flowchart shown in Fig. 8 is applied also In this embodiment, but the process in Fig. 8 is always per- 
formed at a certain interval differently from embodiment 1 . 

35 

(Preferred embodiment 3) 

[0043] Fig. 1 1 shows a structure of a network color reproduction system in an application where network shopping 
on a network is assumed. A purpose of this system is to reproduce a color image of a commodity, i.e., contents of the 
40 network shopping, with correct color on a color reproduction terminal apparatus on a user terminal side. Here, the cor- 
rect color is defined as the color which appears when the commodity is actually placed m a user's environment. There- 
fore, in the color reproduction terminal apparatus, processes such as illumination and chromatic adaptation corrections 
are required. 

[0044] In the network color reproduction system in Fig. 1 1, the network 707 Is connected with the following ele- 
45 ments: 

(1) color reproduction terminal apparatus 705 on the user side; 

(2) color reproduction server 706; and 

(3) image server 1101 for network shopping for providing contents image data 1102 for network shopping and 
50 image-capturing illuminant information 1104. The image-capturing illuminant information means one of spectral 

distribution Information Es(X.) and chromaticity information (Xs, Ys, Zs) of illumination when the image of the com- 
modity of the network shopping is captured.. Color reproduction server 706 stores color conversion part program 
704 and sRGB profile 1103, and sends them to terminal apparatus 705. Terminal apparatus 705 performs color 
conversion. 

55 

[0045] The sRGB profile is a file in whteh a conversion characteristic between an sRGB color space and an XYZ 
color space is described, is generated with a fixed calculation equation, and therefore, is independent of different appa- 
ratuses. This sRGB profile Is not required to be in the color reproduction server and may be in the user terminal side. 
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Here, color specification of each color image on the server is defined as that on the sRGB color space that is virtually 
a standard In the present network world. 

[0046] In the illustration of this embodiment, it is assumed that terminal apparatus 705 obtains a user display profile 
In advance due to the function of color reproduction server 706 in the processes shown by Fig. 7 and Fig. 8. 
5 [0047] Fig. 12 is a flowchart for the color conversion operation of the network color reproduction system for network 
shopping. 

[0048] At step 1201 , image server 1 101 sends out image data written in the sRGB form to terminal apparatus 705 
in response to a request of terminal apparatus 705 on the user sida. At step 1 202, terminal apparatus 705 receives the 
Image data. 

70 [0049] ' At step 1203 and step 1204, terminal apparatus 70S obtairts a color conversion part (a color conversion soft- 
ware module) from color reproduction server 706. This color conversion part ts a program module executed by terminal 
apparatus 705. At step 1205 and step 1206, terminal apparatus 70S obtains an sRGB profile from color reproduction 
server 706. 

[0050] At step 1207, the color conversion part of terminal apparatus 705 converts the image data from the sRGB 
15 form to the XYZ form using the sRGB profile. 

[0051] At step 120B, image server 1 101 sends out image-capturing illuminant information A1 1 04 to terminal appa- 
ratus 705. Terminal apparatus 705 receives information A1 104 at step 1209. At step 1210, illuminant light sensor 206 
on terminal apparatus 705 obtains viewing illuminant Information 811 05, representing the illumination under which the 
user observes the image. 

20 [0052] At step 121 1, terminal. apparatus 705 corrects illumination, chromatic adaptation, and contrast of the XYZ 
value, namely, the image data, based on image-capturing.illuminant information A1 1 04 and viewing illuminant informa- 
tion 81 105. This correction compensates conventional CMS inadequacy where color appearance varies depending on 
illumination or chromatlcity of white, and matches the XYZ value to the color appearance. 

[0053] Terminal apparatus 705, at step 1212, converts the corrected XYZ value in relation to the illumination to an 
25 RGB value, i.e. a display device value with the already obtained own display profile (step 813 of Fig. 8), and, at step 
1213, displays the color Image on the display. 

[0054] Fig. 13 and Fig. 14 illustrate details of illumination, chromatic adaptation, and contrast corrections at step 
121 1. In Fig. 13, (XA, YA. ZA) are tristimulus values XYZ when the image data is captured at step 1207 in Fig. 12. Illu- 
mination under which this image a captured is set as image-capturing illuminant information A. At step 1302, (XA, YA, 
30 ZA) are converted to cone response values (L, M, S) by a Hunt-Pointer-Estevez transformation (for example, refer to 
Naoya Katoh; "Practical Method for Appearance Matcfi between Soft Copy and Hard Copy,' SPIE Vol. 2170, 1 994). 
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[0055] At step 1303 a chromatic adaptation conversion from image-capturing Illuminant Information A to viewing 
Illuminant information B is performed, and at step 1304, the converted values (L' M' S') are obtained. At step 1305, (U 
M' S') are again converted to the XYZ form to obtain (XB, YB, ZB) under illumination B, These conversions are per- 
formed at a time in the following equation responsive to the Von-Kries rule. 
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50 

performed simultaneously in equation (2) response to the Von-Kries rule. In equation (2), LmaxA and LmaxB are max- 
imum values of L under respective environments o1 illuminant. information A and illuminant information B. Similarly, 
MmaxA and MmaxB are maximum values of M, and SmaxA and SmaxB are maximum values of S. 
55 . [0056] Then, at step 1 306, contrast conversion is carried out. This corrects a phenomenon thai an apparent gamma 
vatue varies under variation of illumination. 

XB* = XB^ (3) 
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[0057] Al step 1 307, (XB* YB' ZB') derived after the contrast conversion are output. 

[0058] In the procedures discussed above, the same color appearance as that of the captured contents Is repro- 
duced on the terminal apparatus. The method shown here is written as a program executable by the computer, is stored 
In storage media, and ts executed at color reproduction server 706, server 1101 , and terminal apparatus 705. 

10 

(Preferred embodiment 4) 

[0059] Rg. 14 is a flowchart for a correcting process of illumination, chromatic adaptation, and contrast of a color 
reproduction terminal apparatus In an appfication such as network shopping in accordance with embodiment 4. This 
75 embodiment is different front embodiment 3 in illumination, chromatic adaptation, and contrast corrections shown at 
step 121 1 in Fig. 12. The different part is illustrated in the drawing and discussed below. 

[0060] in embodiment 4, illuminant light sensor 206 of the color reproduction terminal apparatus on a user terminal 
side can measure spectral distribution of illumination. The system in embodiment 3 corrects the XY2 values by deriving 
the cone response LMS values from the derived XYZ values, estimating the chromatic adaptation using the Von-Kries 
20 rule, and performing contrast conversion. This is a method for matching color appearance mainly using a human-visual- 
sense -characteristic, and is called color appearance matching. In embodiment 4» spectral distribution of an object is 
estimated and tristimulus values are reproduced under viewing illumination. 

[0061] The correcting process of illumination, chromatic adaptation, and contrast is Illustrated in detail In Fig. 14. 
[0(^2] Processes at step 1401 are hereinafter described. Tristimulus values (XA, YA, ZA) calculated in reteition to 
25 image-capturing illuminant condition A (Es(^)} are represented by the following integration, where f(X} is object spectral 
distribution. 

XA = fx{X)Es{X)f{X)dk (4) 
30 YA = \y[X)Es{X)f(X)cni. 

ZA = j2(X)Es(A,)/(;L)dX 

[0063] In equation (4), an infinite-dimensional quantity f (A.) is converted to a S-dimensional quantity with integration. 
35 For estimating the infinite-dimensional quantity f(A,), this equation must be solved inversely. Two solution methods are > 
available. 

[0064] In a first method, the infinite-dimensional quantity f(X,) is considered as a P-dimensional vector, and a P- 
dimensional quantity is directly estimated from the three-dimensional quantity. At first, the equation is written in a dis- 
crete form and is represented as a matrix. The integration is performed In a visible wavelength range, I.e., X is between 
AO 380 nm and 7B0 nm. Representing all functions of X as a P-dimensionat vector, equation (4) becomes equation (5). 



X-Tf (5) 



AS 

where, 



so 

* 
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and 3 X P matrix T Is a known matrix generated from discrete fomis yj, Zj of color matching functions y{X), y(X), and 
z(X), and image-capturing illumination Esj. Therefore, the unknown vector f must be solved from viewing quantity vector 
X and 3 X p matrix T, but cannot be accurately solved because dimension P of the unknown vector t is higher than 
dimension 3 of vector X. Estimated vector f is written by 



20 



(7) 



25 



as a pGeudo inverse matrix solution, or 



30 



35 



40 



as a Wiener estimation solution. 

In the Wiener estimation solution, self-correlation matrix E(ff^) is provided from Information provided In advance. 
[0065] In a second method, infinite-dimensional quantity f(X) is estimated by assuming that f(X) is developed and 
represented as e sum of products of known R-dimensional bases e| (X) and weight coefficients a, by a principal compo- 
nent analysis of f(X) or the like. 



This equation is written by 



(9) 



7=1 



46 



ea 



(10) 



so 



in matrix representation, where, 
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where 



is the l-th component of the >th base vector eJ (X) in discrete representation. Substituting equation (1 0) for equation (5), 



25 



X»Tea»Ua 



(12) 



35 



Is dertved. using 3 x R matrix U, namely, the product of 3 x P matrix T and P x R matrix e. Estimation of vector a from 
this equation Involves estimation of an R-dimenslonal vector from a 3-dimensional vector. If R Is In a range of 4 or 6, 
this method is sufficiently practical, and is more accurate than the first method. The estimation method is similar to that 



30 of the first method. As a pseudo inverse matrix solution, 



(13) 



is derived, or as a Wiener estimation solution, 



40 



a -£{aa'}U'(U£{aa'}U')-*X 



(14) 



45 



SO 



Is derived. After vector a is derived, vector f Is derived with equation (9). Processes at step 1 401 finish here. 
[0066] After object spectral distribution vector f, I.e., infinite-dimensional quantity f(5L) is estimated, at step 1402, 
viewing illuminant information B (Eo(^)) is obtained from illuminant light sensor 206. and tristimulus values (XA', YA*. 
ZA*) under viewing illumination are calculated by integration of f(A.) and Eo(X). 



X>\' = Jx(A,)Eo{X)/(A,)ca 
YA*=\y{X)Eo{X)f(X)dK 
= i2{X)EoiX)f{k)dk 



(15) 



55 (Preferred embodiment 5) 



[0067] Fig. 1 5 shows a structure of a network color reproduction system In an application such as network shopping 
in accordance with ennbodiment 5 of the present Invention. 
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• [0068] The system in accordance with this .embodiment estimates spectral distribution of an object Image, and per- 
forms color reproduction for reproducing it with a multl-prlmary-color projector or a murtl -primary-color display at an out- 
put terminal Multi-color color reproduction has two advantages. As a first advantage, spectral color reproduction is 
easier comparing with the reproduction where only tristimulus values XYZ are matched. When the spectral color repro- 
duction can be realized, a conventional problem, i. e., that color appearance varies depending on illumination even if 
the same XYZ values are employed, is resolved. As a second advantage, a larger color gamut than that achieved by 
three-primary-color reproduction can be realized. 

[0069] The network color reproduction system in the network shopping as shown in Fig. 1 5 Is constituted with color 
reproduction server 706, image serveniOl for network shopping, and color reproduction terminal apparatus 1506 
Object spectral distribution estimating program 1501 is stored in color reproduction server 706. This program is sent 
from server 706 to terminal apparatus 1506 where it is operated. If this program is operated on server 706 a huge 
amount of spectral characteristic image data must be transfen'ed to terminal apparatus 1506 through network 707 To 
avoid this, this system operates this program in the terminal apparatus. Image data 1 102, I.e., contents, are stored In 
image server 1101. The stored form of image data 1 102 is N-band color image captured by a normal color camera or 
a multi-speclral camera in this embodiment. When N=3. this is an RGB image captured by a usual color camera. In 
addition, the stored form can also be spectral distribution data or compressed spectral data. 

[0070] The spectral distribution of a natural matter, i.e., an object, is generally infinite dimensional, but is assumed 
discretely as M-dimensional data (M > N). This IVI-dimensional data is about 100-dlmenslonal data sampled from a nor- 
mal vjsible range, namely, about a 400 nm spectral range between 380 nm and 780. nm, every 4nm. Actual spectral dis- 
tnbution, however, has a degree of freedom not so high as 100, and usually, can be sufficiently represented by a 
relatively small number of base vectors. 

[0071] Image server 1101 stores the following information: 

(1) object spectral distribution base information 1503, namely. R base vectors sampled every specific image in a 
principal component analysis based on the analysis of images stored as the contents; 

(2) image-capturing iilumlnani spectral information 1604 when a content's image Is captured; and 

(3) filter information 1 505 of the color camera with which the contents image are captured. 

■ * * 

Terminal apparatus 1506 has a projector where a number of primary colors can be easily ©(tended over three, and this 
projector is observed in a darkroom. 

[0072] Fig. 1 6 illustrates an operation of a network color reproduction system in accordance with this embodiment. 
At step 1 601 and step 1 602, temninal apparatus 1 506 receives image data 1 1 02 from image server 1 101 responsive to 
a request of temninal apparatus 1506. At step 1603, temiinal apparatus 1506 obtains camera filter characteristic infor- 
mation of the camera that captures image data 11 02 from image server 1101, and image-captured illuminant spectral 
information during capturing. At step 1604, tenninai apparatus 1506 obtains spectral distribution base information 
1503, namely. R base vectors of the spectral distribution of an object included in image data 1 1 02. 
[0073] Then, at step 1 605. color reproduction server 706 sends out object spectral distribution estimating program 
1501 to terminal apparatus 1606. At step 1606, spectral distribution of image data 1 102 is estimated. The estimation is 
achieved by estimating R weight coefficients aj in relation to R bases based on an N-bandxolor signal. The estimation 
without using any base vector generally has poor accuracy because it is a considerably difficult work In which variables 
of P-dimensional spectral data (about 50 dimensions) must be estimated from N bands. Employing the base vectors 
improves estimation accuracy. In this estimation method, a pseudo inverse matrix solution or a Wiener estimation solu- 
tion can be used. Then, the k-th sensor output gj, of the N bands can be represented as follows, using sensor spectral 
characteristic S|^(\). illumination Es{X.), and object spectral reflectance f(A,). 

9f, = lS^,(X)£s(X)HX)dX (16) 

[0074] Assuming that f(X) is developed on R bases as equation (9) due to its statistical property, equation (16) is 
written as . ^ \ / 

fl'fc = La^Sfc(>.)£s(X)e'(?.)dX (17) 
Writing this In a discrete form and representing this as a matrix, 
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[0075] Because the form of equation (1 8) is finally the same as that of equation (12), vector a is estimated and ^X) 
is derived using the pseudo inverse matrix solution or the Wiener estimation solution, as shown in equation (13) and 
30 equation (14). 

[0076] Al step 1609, multi-primary-color conversion is performed for reproducing the derived spectral distribution 
as it is. This conversion is required in a general case that the number of dimensions of the derived base vector is differ- 
ent from the number of primary colors finally reproduced. At step 1610, data derived by the multi-primary-color conver- 
sion is displayed on a multi- primary-color projector. 
35 [0077] Now, Fig. 17 will be discussed, shows two process systems In the multi-primary-color conversion process 
shown at step 1 609. 

[0078] Process system 1 intends spectral color reproduction as a color reproduction target. Based on estimated P- 
band ((dimensional) spectral distribution data 1700 of a color image, reproduction target spectral distribution 1701 is 
derived considering viewing illuminant condition 1703. At step 1702, color conversion 1 702 Is performed for converting 
40 P-band primary colors to Q primary colors, namely, P-dimension to Q-dimenslon, so as to obtain a spectral distribution 
as close to spectral distribution 1701 as possible. 

[0079] If the viewing illuminant condition is inside of a darkroom, reproduction target spectral distribution 1701 is 
spectral distribution data 1700 itself of an object. Spectral distribution 1701 is reproduced using a spectral distribution 
of Q primary colors. An approximate value of infinite-dimensional quantity f{X,) is generated by using spectral character- 
45 . istic L|(X) (1 <=i<=Q) of Q primary colors and weight coefficients Wj. 



so 
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Representing this In a matrix, 
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Using least square error J as an evaluation standard of vector f, 



0 



30 



dX 

/ = (f-f)'(f-f) 



(23) 



Is derived. SoMng this, vector W can tie calculated as the following pseudo Invierse matrix. 



35 



(24) 



40 



When spectral data vector t Is represented by a sum of R-dlmenslonal bases as shown In equation (9), conversion from 
P-dlmension to Q-dimenslon is not required. Mult1-primar7-co lor conversion 1609 Is more easily realized by performing 
conversion 1707 from R-dimension to Q-dimension. In this case, vector W is represented, as shown below, using matrix 
e and vector a in equation (11). 



45 



(25) 



[OOao] In process system 2, Iristimulus values are matched although mutti-primary-coior reproduction Is performed. 
Reproduction target XY2 value 1704 is calculated from estimated spectral distribution 1700 using the I, age-capturing 
illuminant condition and viewing illumlnant condition 1706, The 3-dimensional XYZ value is converted to Q primary 
color (Q>3). Target XYZ value 1704 is derived by multiplying spectral distribution by a color matching function and by 
55 integrating them, and is corrected wider an illuminant condition. This correction can be performed in either method 
shown in Fig. 13 or Fig. 14. The number of solutions of the conversion to Q primary color for generating the same XYZ 
value is infinite, but the solutions can be derived as shown below. For example. 
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(26) 

X-(SL)W 

Is Bssumed, where vector X represents target tristimulus values, and matrix S is a matrix which represents color match- 
ing functions x{X), y(X}, and z[X) in discrete form. 



x = (x Y z)' 



(27) 



Xj Xp 

yi yi •" yp 

«i *3 *• 



As a pseudo inverse matrix solution of vector W, 



W - (SLy((SLXSLy)~*X 



is derived. 

As a Wiener estimation solution, 



W - £{W W'XSJLy ((S L)i^{W W'KSL)')-'X 

is derived, where, sell-correlation matrix of vector W is provided In advance. 
(Preferred embodiment 6) 

AO [0081] Fig. IB shows a structure of a network color reproduction system applied to a remote medical care service 
system or a TV meeting system in accordance with embodiment 6. Images processed in this embodiment are moving 
images, which are generally different from those for network shopping. 

[0082] Color reproduction temninal apparatus A1B01 on a user Aside, color reproduction terminal apparatus B 
1802 on a user B side, and color reproduction server 706 are placed on network 707. Color conversion part program 

45 704 is placed in server 706. Terminal apparatuses A1 801 , Blfi02 capture images of the faces of respective users, set- 
ting camera positions as shown in example 320 in Fig, 3. In the remote medical care service system, it is not required 
that both users see correct color, and color reproduction only on a doctor side Is required to be accurate. A purpose of 
this system Is to allow the user 8 to watch complexions or affected parts of opponents with accurate colors. 
[0083] As a precondition, as shown in embodiment 1 and embodiment 2, users A, 8 obtain a camera profile, a dis- 

50 play profile, a sRGB profile, and color conversion part program 704 from color reproduction server 706. 

[0084] In Fig. 1 9, at step 1 900, iiluminant light sensor 206 attached to cokir reproduction terminal apparatus A 1801 
on the user A side obtains iiluminant information A around terminal apparatus A1801. At step 1901, the image of user 
A is (captured by a camera 203 to provide captured-image data A. At step 1 902, color conversion part program 704 tem- 
porarily converts captured-image data A into the XYZ form using the camera profile A, and then, at step 1 903, converts 

55 it to the sBGB form using the sRGB profile. At step 1904, captured-image data A in the sRGB form and viewing iilumi- 
nant information A are sent to network 707. 

[0085] Color reproduction terminal apparatus B1 802 on user B side obtains captured-image data A and viewing iilu- 
minant information A at step 1905. At step 1906, terminal apparatus 61802 converts captured-image data A from the 
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sRGB form to the XYZ form using the sRGB profile of color conversion part program 704. At step 1907, terminal appa- 
ratus B1802 converts captured -I mage up data A(X Y Z) to captured-lmage data A{X' Y' 2') by correcting Illumination, 
chromatic adaptation, and contrast using viewing illumlnani information A. Terminal apparatus 81 802 converts cap- 
tured-lmage data A(X* Y' Z*} to the RGB form for display B using display profile B at step 1908. and displays the image 
5 of user A on display B at step 1 909. The color of captured-image data A on the user A.side is accurately reproduced on 
terminal apparatus B 1802. 

[0086] On the other hand, for sending captured-image data B of temiinal apparatus B1802 to terminal apparatus 
A1 B01 and reproducing its color, step 1 900 to step 1 909 discussed above are repeated. 

[0OB7] In detail, image-capturing iiluminant information B around terminal apparatus B1802 is obtained at step 
• 70 1 910, and user B is captured to provide captured-lmage' data B at step 1911. Color conversion part program 704 con- 
verts captured-image data B to the XYZfomi at step 1912, and converts it to the sRGBform at step 1913. 
[0088] The converted sRGB captured-image data B and viewing iiluminant information 6 are sent out onto the net- 
work at step 1914, and are received by terminal apparatus A1 601 at step 1 91 5. The terminal apparatus A1 801 converts 
captured-image data B from the sRGB form to the XYZ form at step 1916, corrects captured-image data B(X Y 2) In 
IS relation to Illumination, chromatic adaptation, and contrast at step 1917, converts the corrected data to the RGB form 
for display A at step 1918. and displays this RGB data at step 191 9.-Thus, the complexion of user B is correctly repro- 
duced on the display A. 

[0089] By repeating the processes discussed above, mutual complexions can be interactively and correctly repro- 
duced on mutual displays, and thus network color reproduction is completed. 
20 [0090] Although, the present invention has been fully decsribed by the way of examples with reference to the 
accompanying drawings, it should be understood that numerous variations, modifications, and substitutions, as well as 
rearrangements and combinations, o1 the proceding illustrative embodiments will be apparent to those skilled. 

Claims 

1 . A color reproduction terminal apparatus comprising: 

color image display meens for displaying a color image; 

characteristic capturing means for capturing a color reproduction characteristic of said color irnage display 
means and a viewing iiluminant condition, by employing at least one of a color camera and a sensor; and 
color conversion means for performing color conversion of a received color Image obtained through a network 
using the color reproduction characteristic and the viewing iiluminant condition to obtain a corrected color 
imaga, and for outputting the connected color image to said color image display means. 

The color reproduction terminal apparatus according to claim 1, wherein said color conversion means performs 
color conversion to the color image using (i) at least one of a color conversion profile and a color conversion pro- 
gram which are downloaded through the network, (ii) the color reproduction characteristic, and (ill) the viewing iilu- 
minant condition. 

3. The color reproduction terminal apparatus according to claim 1, wherein: 

^ 

said characteristic capturing means Includes the color camera and a sensor, 

the color camera includes at least one of a display capturing camera and a person capturing camera, and 
the sensor includes an iiluminant sensor. 

4. The color reproduction terminal apparatus according to claim 1, wherein said color image display means includes 
one of a liquid crystal display, a CRT display, and a projector. 

" J • 

5. The color reproduction terminal apparatus according to claim 1, wherein: 
said characteristic capturing means Includes the color camera; and 

the color camera includes one of a digital still camera, a digital video camera, and a muiti-spectral camera. 

6. The color reproduction terminal apparatus according to claim 1, wherein said characteristic capturing means 
55 includes a camera- head-positlon-moving-mechanism for moving the color camera so as to capture an operator and 

a display screen of said color image display means. 

7. The color reproduction terminal apparatus according to claim 1, wherein: 
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said characteristic capturing means includes the color camera and the sensor, and 

the color camera and the sensor always or intermittantly photograph at least a portion of a display screen of 
said color image display means. 

5 8. The color reproduction terminal apparatus according to claim 1 , wherein said color conversion means includes: 

means for estimating a spectral distribution of an object from a spectral characteristic of an image capturing 
camera and illuminant spectral information; and 

means for estimating tristtmuius values of the object based on the viewing illuminant condition. 

10 

9. The color reproduction terminal apparatus according to claim 1 , wherein said color conversion means further 
includes means for one of generating and updating a display profile of said color image display means from color 
patch data, a plurality of camera profiles, a profile generating program, and a color conversion program. 

15 10. The color reproduction terminal apparatus according to claim 2, wherein said color conversion means further 
includes means for downloading at least one of color patch data, a plurality of camera profiles, a profile generating 
program, and the color conversion program through the network, and said color conversion means further com- 
prises means for one of generating and updating a display profile of said color image display means. 

20 11 . The color reproduction terminal apparatus according to claim 1 , wherein the color image is a moving image* 

12. A color reproduction server apparatus comprising: 

means for storing a color conversion profile and a color conversion program; and 
25 means for supplying the color conversion profile and the color conversion program through a network to a color 

reproduction terminal apparatus in response to the request from the color reproduction terminal apparatus, 
whereby the color reproduction terminal apparatus Is enabled to perform color conversion using the color con- 
version profile and the color conversion program. 

30 13. A network color reproduction system comprising: 

(a) a color reproduction terminal apparatus comprising: 

(a-1) color image display means for displaying a color image; 
35 (e~2) characteristic capturing means for capturing a color reproduction characteristic of said color image 

display means and a viewing illuminant condition by employing at least one of a color camera and a sen- 
sor; and 

(a-3} color conversion means for performing color conversion to a received color image obtained through 
a network using the color reproduction characteristic and the viewing illuminant condition to obtain a cor- 
40 rected colorimage, and for outputting the color image to said color image display means; and ■ 

(b) a color reproduction server apparatus comprising: 

(b-1) means for storing a color conversion profile and a color conversion program; and 
45 (b-2) means for supplying the color conversion profile and the color conversion program through the net- 

work to said color reproduction terminal apparatus in response to a request from said color reproduction 
terminal apparatus. 

14. The network color reproduction system according to claim 13, wherein: 

so 

(c) said color reproduction server apparatus further includes: 

(c-1) means for storing a1 least one of a color patch data, a plurality of camera profiles, an sRGB profile, a 
color conversion program, and a color conversion profile generating program; and 
55 (c-2) means for supplying at least one of the color patch data, the plurality of the camera profiles, the sRGB 

profile, the color conversion program, and the color conversion profile generating program through the net- 
work to said color reproduction terminal apparatus in response to a request from said color reproduction 
terminal apparatus; and 
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(d) said color reproduction terminal apparatus further includes 

(d-1) means for dowriloading at least one of the color patch data, the plurality of the camera profiles, the 
sRGB profile, the color conversion program, and the color conversion profile generating program through 
5 the network. 

15. The network color reproduction system according to claim 13 further including 

(e) an image server apparatus comprising: 

(e>1) means for storing image data; and 

{e-2) means for supplying the image data through the network to said color reproduction terminal appara- 
^ tus in response to a request from said color reproduction terminal apparatus. 

IS 16. The network color reproduction system according to claim 15, wherein said image server apparatus further 
includes means for storing at least one of a multi-spectral color image comprising a plurality of bands, spectral dis- 
tribution information of Image capturing illuminant, filter spectral characteristic information of a color camera used 
for capturing a Image, and base vector information of spectral distribution of the color image. 

20 17. The network color reproduction system according to claim 13, wherein said color reproduction tenninal apparatus 
further includes estimating means for estimating original spectral distribution from the received color image 
'obtained through the network. 

18. The network color reproduction system according to claim 17, wherein said color reproduction terminal apparatus 
2S . further includes means for downloading a program used in said estimating means from said color reproduction 

server apparatus through the network * 

19. The network color reproduction system according to claim 13, wherein the color image is a moving image. 
30 20. A color reproduction terminal apparatus comprising: 

means for inputting a multi-spectral color image comprising P dimensions; 
means for determining a target spectral distribution to be reproduced; 

color conversion means for converting the target spectral distribution in a P-dimensional color space to a . spee- 
ds tral distribution in a Q-dimensional color space; and 

means for outputting a color image based on the input color image in accordance with the spectral distribution 
in the Q-dimensional color space. 

21. A color reproduction terminal apparatus comprising: 

40 

means for inputting a multi-spectral color image comprising P dimensions; and 

color conversion means for converting the input color image to an R-dimensionat vector using R base vectors 
for approximating spectral distribution, where P is equal to or greater than R. and converting the R-dimensional 
vector to Q primary colors. 

45 

22. A color reproduction terminal apparatus comprising: 
means for inputting a multi-spectral color image comprising P dimensions; 

means for determining a plurality of attributes of a color appearance model of a reproduction target with an illu- 
minant condition and a viewing illuminant condition; 
means for converting the attribute values to Q primary colors; and 

means for outputting a color image, based on the input color image, using the Q primary colors. 

The color reproduction terminal apparatus according to claim 20, 21. or 22, wherein the color image is a moving 
image. 

A color-reproduction method comprising the steps of: 
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(a) downloading at least one of a color conversion profile and a color conversion program through a network; 

(b) capturing a color reproduction characteristic of a color 'mage display and a viewing illunninant condition by 
ennp joying at least one of a color camera and a sensor: 

(c) converting color of a color image obtained through the network using 0) at least one of the color conversion 
profile and the color conversion program, (ii) the color reproduction characteristic, and (iti) the viewing illumi- 
nant condition; and 

(d) outputting a color image converted In said step (c) of converting to color image display. 

25. A color reproduction method comprising the steps of: 

storing a color conversion profile and a color conversion program; arnjl 

supplying the color conversion profile and the color conversion program to a color reproduction terminal appa- 
ratus through a network m response to a request from the color reproduction terminal apparatus, to enable the 
color reproduction terminal apparatus to perform color conversion using the color conversion profile and the 
color conversion program. 

26. A computer readable recording medium in which a program is recorded for making a computer execute a color con- 
version method using at least one of a color conversion profile and a color conversion program, the color conver- 
sion method comprising the steps of: 

(a) downloading the color reproduction profile and the color reproduction program through a network 

(b) capturing a color reproduction characteristic of the color Image display means and a viewing illuminant con- 
dition by employing at least one of a color camera and a sensor; 

(c) converting color of the color image obtained through the network using (i) at least one of the color conver- 
sion profile and the color conversion program, (ii) the color reproduction characteristic, and (iii) the viewing illu- 
minant condition; and 

(d) outputting the color image converted in said step (c) to the color image displaying means. 

27. A computer readable recording medium in which a program is recorded for making a computer execute a color 
reproduction method, the color reproduction method comprising the steps of: 

storing a color conversion profile and a color conversion program; and 

supplying the conversion profile and the conversion program to a color reproduction terminal apparatus 
through a network in response to a request from the color reproduction terminal, 

whereby the color reproduction terminal is enabled to perform color conversion using the conversion profile 
and the conversion program. 

28. A program for making a computer execute a color conversion method using at least one of a color conversion profile 
and a color conversion program, the color conversion profile and the color conversion program for being down-, 
loaded through a network, the color conversion method comprising the steps of: 

(a) capturing a color reproduction characteristic of the color image display means and a viewing illuminant con- 
dition by employing at least one of a color camera and a sensor; 

(b) converting color of the color image obtained through the network using (i) at least one of the color conver- 
sion profile and the color conversion program, (ii) the color reproduction characteristic, and (iii) the viewing illu- 
minant condition; and 

(c) outputting the color image converted in said step (b) to the color image displaying means. 

29. A program for making a computer execute a color reproduction method of a color reproduction server, the color 
reproduction method comprising the steps of: 

storing a color conversion profile and a color conversion program; and 

supplying the conversion profile and the conversion program to a color reproduction terminal apparatus 
through a network in response to a request from the color reproduction terminal apparatus, 
whereby the color reproduction terminal apparatus is enabled to perform color conversion using the conversion 
profile and the conversion program. 
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Fig, 1 
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